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Abstract — A code for communication over the fc-receiver ad- 
ditive white Gaussian noise broadcast channel with feedback is 
presented and analyzed using tools from the theory of linear 
quadratic Gaussian optimal control. It is shown that the per- 
formance of this code depends on the noise correlation at the 
receivers and it is related to the solution of a discrete algebraic 
Riccati equation. For the case of independent noises, the sum 
rate achieved by the proposed code, satisfying average power 
constraint P, is characterized as l/21og(l + P4>), where the 
coefficient <j!) G [1, fc] quantifies the power gain due to the presence 
of feedback. When specialized to the case of two receivers, this 
includes a previous result by Elia and strictly improves upon 
the code of Ozarow and Leung. When the noises are correlated, 
the pre-log of the sum-capacity of the broadcast channel with 
feedback can be strictly greater than one. It is established that 
for all noise covariance matrices of rank r the pre-log of the 
sum capacity is at most fc r + 1 and, conversely, there exists a 
noise covariance matrix of rank r for which the proposed code 
achieves this upper bound. This generalizes a previous result by 
Gastpar and Wigger for the two-receiver broadcast channel. 

I. Introduction 

Consider the communication problem over the fc-receiver 
additive white Gaussian noise (AWGN) broadcast channel 
(BC) with feedback depicted in Fig. [T] Here, a sender wishes 
to communicate k independent messages to k distinct receivers 
that observe the sequence of transmitted signals corrupted 
by k, possibly correlated, AWGN sequences. It is known that 
the presence of feedback from receivers to sender improves 
communication performance over broadcast channels. Specifi- 
cally, Dueck [1| showed, by providing a specific example, that 
feedback can enlarge the capacity region of additive memory- 
less broadcast channels where the noises at the receivers are 
correlated, while Ozarow and Leung [21 proved that feedback 
can be beneficial by providing a means of cooperation between 
receivers and sender even when the noises at the receivers are 
independent. However, a computable characterization of the 
capacity region of this channel remains a long-standing open 
problem. 

In this paper, we construct a code, which we refer to as LQG 
code, for communicating over the AWGN-BC with feedback 
and we characterize its performance using tools from optimal 
control. We show that the minimum power needed by the 
LQG code for reliable transmission of messages encoded at 
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a given set of rates depends on the correlation between the 
noises at the receivers and is determined by the solution of 
a discrete algebraic Riccati equation (DARE) which arises in 
the analysis of the linear quadratic Gaussian (LQG) optimal 
control problem. The LQG code is then used to investigate 
some properties of the capacity region of the AWGN-BC with 
feedback. 

First, we consider the case of independent noises at the 
receivers, which is the most interesting in practice. By solving 
the corresponding DARE, it is shown that the LQG code 
achieves sum rate equal to l/21og(l + P(j){k,P)) under 
average power constraint P when messages are encoded at the 
same rate. Here, the real coefficient (j){k, P) E [1, k] represents 
the power gain compared to the no-feedback sum capacity 
l/21og(l + P), and for fixed k it is increasing in P, that 
is, more power allows more gain. In particular, as P — > oo, 
(j> ^ k, and the sum rate tends to 1 /2 log(l+fcP), which is the 
same as the sum capacity of the single-input multiple-output 
(SIMO) channel. Note that in the SIMO channel the receivers 
are co-located, whereas in the AWGN-BC the receivers are 
separately located but feedback links to the transmitter are 
available. Hence, the power gain due to feedback can be 
interpreted as the amount of cooperation among the receivers 
established through feedback, which allows the transmitter to 
align the signals intended for different receivers coherently 
and use power more efficiently. 

Next, we investigate how the sum capacity, the supremum of 
achievable sum rates, scales as the power P at the transmitter 
increases. If the sum capacity scales as (7/2)log(l + P) as 
P ^ oo, then we refer to 7 as the pre-lo^ of the channel. 
We show that the pre-log of the AWGN-BC with feedback 
depends on the rank of the correlation matrix of the noises 
at the receivers. Specifically, if the rank is r, then the pre-log 
can be at most k — r + 1. Conversely, for any r e {!,..., k}, 
there exists a noise covariance matrix of rank r for which the 
upper bound on the pre-log is tight and is achieved by the 
LQG code. In particular, the pre-log is equal to k for some 
rank-one covariance matrix. This generalizes a previous result 
by Gastpar and Wigger [31 for the two-receiver AWGN-BC to 
the case of k receivers. 

Finally, we wish to mention some additional related works. 
Elia H followed a control-theoretic approach and presented a 
linear code for the two-receiver AWGN-BC with independent 
noises, which outperforms the Ozarow-Leung (OL) code [Zj. 
Our code, when specialized to the case of two receivers 
and independent noises, provides the same performance as 

'The pre-log is also known as the number of degrees of freedom as it is 
equal to the number of orthogonal point-to-point channels with the same sum 
capacity. 
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Elia's code IIU. Wu et al. Q applied the LQG theory to 
study Gaussian networks with feedback, where the noises at 
the receivers are independent, but did not provide exphcit 
solutions. Along the same lines, it has been shown in (6] 
that the linear code proposed by Kramer [7| for the fc-sender 
multiple access channel with feedback can be obtained by 
solving an LQG control problem. 

It is worth noting that the LQG code is derived from an 
optimal control for a linear system and hence is optimal among 
the subclass of hnear codes. For the AWGN-BC with feedback, 
we show that the LQG code provides better performance 
compared to the OL code for k = 2 and hence outperforms 
the Kramer code |7| for fc > 3, which is an extension of the 
OL code. However, it remains to be proven whether the LQG 
code achieves the feedback sum capacity. 

The rest of the paper is organized as follows. Section 
presents the problem definition. Section |III]discusses the point- 
to-point communication problem over the AWGN channel 
with feedback from a control theoretic perspective. This view- 
point is then generalized in Section IIVI which presents the 
LQG code for communicating over the fc-user AWGN-BC with 
feedback. The following two sections are devoted to studying 
the performance of the LQG code: in Section |V] we provide 
the analysis for the case of independent noises at the receivers, 
while in Section |Vl] we characterize the pre-log gain when the 
noises are correlated. Finally, Section IVlIl concludes the paper. 



2) an encoder that assigns a symbol Xi(M,Y*^^) to the 
message vector M and the previous channel output 
vectors Y*^^ for each i E {!,..., n}, and 

3) k decoders, where decoder j assigns an estimate Mj to 
each sequence Y" := {Yji, . . . , lj„). 

Let Ml, . . . , Mk be independent and the probability of error 
be defined as 

p{n) ^ p^j^j^ ^ fQj. gQj^g --^^ 

Then, we say that (i?i, . . . , Rk) is an achievable rate vector 
under (asymptotic block) power constraint P if there exists a 
sequence of (2"-'^i , • ■ • , 2^^'^ , n) codes such that 



lim Pi") = 



and 



limsup-y^E(Xf) < P. 

n—>oo ^ 



(2) 



We refer to i? = '^he sum rate of an achievable 

rate vector 

Definition 2: The closure of the set of achievable rate 
vectors (i?i, . . . , Rk) under power constraints P is called the 
capacity region '^{P,Kz)- The sum capacity C{P,Kz) is 
defined as 



n. Dehnitions 

Consider the communication problem where a sender 
wishes to communicate k independent messages Mi , . . . , M^ 
to fc distinct receivers by n transmissions over the AWGN- 
BC channel with feedback depicted in Fig. [T] At each time 
i £ {1, . . . , n}, the channel outputs are given by 



(1) 



where Xi is the transmitted symbol by the sender and Ifcxi — 
(1, . . . , 1)"'^ is the column vector of ones of length fc. The 
vector Yi :— {Yu, . . . ,YkiY' contains the fc channel outputs 
at time i, that is, Yji is the channel output for the receiver j 
at time i. Similarly Zji denotes the noise for the receiver j at 
time i. The noise vector 



N{0,K,) i.i.d. 



is assumed to be independent of the transmitted messages, and 
independently and identically distributed (i.i.d.) from a Gaus- 
sian distribution with zero mean and covariance matrix Kz- 
Without loss of generality, we assume that Zji ^ N(0, 1) has 
unit variance, so the diagonal elements of are equal to one. 

We assume that the output symbols are causally and 
noiselessly fed back to the sender so that the transmitted 
symbol Xi at time i can depend on the message vector 
M :— (Ml, . . . , Mfe)-^, and the previous channel output 
vectors Y*^i :^ (Yi, . . . , Y,_i). 

Definition 1: A (2"^i , . . . , 2"^" , n) code for the AWGN- 
BC with feedback consists of 
1) fc discrete messages Mj ^ Unif{l, . . . , 2"^^ }, 



C{P,K,) :=max|^^i?, : (Ri, Rk) e '^{P, 
and the pre-log ^{Kz) is defined as 

^log(l + P) 

Definition 3: An n-code for the AWGN-BC with feedback 
consists of 

1) fc continuous messages Qj ~ Unif(0, 1) 

2) an encoder that assigns a symbol Xi(0,Y*^^) to the 
message vector = {Qi, . . . ,<dk)^ and the previous 
channel output vectors Y*^^ for each i G {!,..., n}, 
and 

3) fc decoders, where decoder j assigns an estimate Qj to 
each sequence Y^" ~ (Yji,. . . , Yjn). 

Let Qi, . . . ,Qk be independent and the mean square errors 
-D^"^ , ■ • • , -D^"' at time n be defined as 

i^J"^ = E(e,-e,f, j^i,...,k. 

Then, we say that (£'1, . . . ,Ek) is an achievable mean square 
error (MSE) exponent vector under (asymptotic block) power 
constraint P if there exists a sequence of n-codes such that 



1 



= lim -—\ogD^"\ j = l,...,fc 
and Q holds. 

The definitions of achievable MSE exponent and rate vectors 
are closely related, as established by the following lemma. 
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M = (Mi,...,Mfc) 




Fig. 1. The fc-receiver AWGN broadcast channel with feedback. 



Lemma 1: Let {Ei, . . . ,Ek) be an achievable MSB expo- 
nent vector under power constraint P, and . . . ,Rk) be 
such that 

Rj < Ej, j = l,...,fc. 

Then, the rate vector . . . ,Rk) is achievable under power 
constraint P. 

Proof: See Appendix lAl 

III. LQG Approach: Point-to-Point Channels 

Before presenting the LQG code for the AWGN-BC, we 
first revisit the communication problem over the point-to-point 
AWGN channel with feedback in Fig. [21 and demonstrate 
how the theory of LQG control can be used to design codes 
for communication over such channel. It is well known (4] 
that the capacity-achieving code by Schalkwijk and Kailath 
(SK) O, (9| can be derived as the solution of an optimal 
control problem. However, here we provide a derivation of 
this result that naturally generalizes to the case of multiple 
receivers. 

Let S*! e K. be the initial state of an unstable linear system 
with open-loop dynamics 



= aSj,- 



1 = 2,3,. 



for some coefficient a > 1, that is stabilized by a controller 
having full state information and where the control signal is 
corrupted by AWGN (see Fig. |3)- The closed-loop dynamic 
of this system is given by 



where 



and 



Y,.- 



2,3, 



N(0,1) 



(3) 



(4) 



(5) 



The mappings {TTij^j^ are referred to as the control, and the 
linear dynamical system in (O, which is characterized by the 
unstable mode a, is simply referred to as the system. We say 
that a control is stabilizing if limsupj_j.o2 E(S'j^) < oo. 

Given a control (|5]l for the system (|3}, we construct a 
sequence of n-codes for the point-to-point AWGN channel (|4|i 



with feedback (cf. Definition 3 in the special case of /c = 1) 
as follows. 

1) Encoder: Given a continuous message 8 ^ Unif(0, 1), 
the encoder recursively forms 



51 = e 

Si = aSi-i 



y,_i, i = 2,i,...,n (6) 
- T^iiSi) for each i e 



and transmits Xi{Q,Y^^^) 
{l,...,n}. 

2) Decoder: the decoder sets Oj = —a ^Si+i as an estimate 
of the message 8, where Si is recursively formed as 



Si=0 
Si = aSi-i 



Y,- 



1 = 2,3,. 



(7) 



Lemma 2: If the control {iii} stabilizes the system with 
open-loop mode a > 1, then the n-code described by ^ 
and (|7]l achieves MSB exponent E = log a under power 
constraint 



P = limsup- VE(7r2(50). 



(8) 



Proof: Combining ^ and (|7]i we have 

Si+i = a*0 + 5^+1 

= a*(e-e,) 



(9) 



where the last equality follows from the fact that 9^ = 
-a-~'S,+i. From dS, the MSB of the estimate e„ is Z)'"' = 



E(e-e„)2 



-2n 



^i^n+i)- Since the control is stabilizing 



we know limsup^^^o E(>5'„) < oo and hence 



E : 



lim 

71— >00 



2n 



losL*'") = he- a. 



Noting that Xi = Tri{Si), we conclude that MSB expo- 
nent log a is achievable under asymptotic power equal to 
limsup„^^ i E(7rf (5*0). ■ 

Lemma |2] shows that for a fixed a > 1 any stabilizing 
control yields a code achieving MSB exponent E = logo. 
In general, though, different codes require a different asymp- 
totic power constraint (|8). Thus, we are interested in finding 
the stabilizing control whose associate asymptotic power is 
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Fig. 2. The AWGN channel with feedback. 



Controller 

Xi = TTi{Si) 



~ N(0, 1) 



— ^ 



System 



Fig. 3. Stabilization over the AWGN channel. 



minimal. It is known from the theory of LQG control llTOl 
that the linear stationary control 



X; = -cS., i 1, 2, 



(10) 



where c 



power dSJ, which is given by 



l)/a attains the minimum asymptotic 



1. 



Hence, from Lemma |2] the linear code corresponding to this 
optimal LQG control, which we refer to as the LQG code, 
achieves the MSE exponent 

loga= ilog(l + P*) 

under power constraint P* . By Lemma [l] when specialized 
to fc = 1, we conclude that the LQG code achieves any rate 
R < log a = 1/2 log(l + P*) under power constraint P*, and 
hence is capacity achieving. 

A natural question to ask is what is the connection between 
the LQG code and the SK code, where the sender recursively 
transmits the estimation error at the receiver? To answer this 
question, note that combining (|6]l and dTol l we can write a 
recursion for the channel input Xi as 



X. 



i+l 



(11) 



with Xi — — c0. The recursion converges, irrespectively of 
the initial value, since a — c=l/a<l. On the other hand, 
the channel input update in the SK can be represented by the 
following recursion ifTTI . 



X. 



i+i 



X, 



E(x,y,) 



Y,, 



(12) 



with Xi = Q. Comparing ( fTTT i and ( fT2] i. we can see that the 
LQG code is asymptotically equivalent to the SK code if 



as I — >■ oo 



(13) 



such that, in steady state, {c/a)Yi tends to the minimum mean 
squared error estimate of Xi given Fj. 

By plugging ( fTOl ) into (|6]l, we have the closed-loop dynamics 
for Si as 

Si ~ a Si-i + Zi^i. 

As i — > cx) the second moment of the state converges to 
a^/(a^ — 1) and since Xi = ~cSi, 



E(y,2) ^ a' 

Therefore, as i — > oo, 

E(X,r,) E{Xf) 



1 



E(F.^) ^Yn 

where the last equality follows from the fact that the optimal 
control is given by c = (a^ — I) /a. Hence, the LQG code and 
the SK code are asymptotically equivalent. 

IV. LQG Code: AWGN Broadcast Channel with 
Feedback 

In this section we extend the control theoretic approach to 
the case of a fc-receiver AWGN-BC with feedback. We do so 
by considering the control problem depicted in Fig. |4] in which 
a fc-dimensional unstable dynamical system is stabilized by a 
scalar controller having full state observation and where the 
scalar controller is perturbed by k, possibly correlated, AWGN 
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Fig. 4. Control over the AWGN broadcast channel 



noises, each affecting a different component of the state vector. 
We show that any controller stabilizing the system in mean- 
square sense yields a code for the fc-receiver AWGN-BC with 
feedback. In particular, the LQG code is obtained from the 
minimum variance stabilizing control which can be computed 
using the LQG control theory. 

A. Code Design Based on a Control Approach 

Assume for simphcity that channel input and outputs in ^ 
are complex numbers and that the additive noise vector is 
drawn i.i.d. from a circular symmetric complex Gaussian 
distribution with covariance Kz- It is easy to see that if 
(i?i , . . . ,Rk) is achievable under power constraint P per each 
real dimension of the complex channel, then . . . ,Rk) is 
achievable under the same power constraint over the original 
real channel. In fact, one transmission over the complex 
channel can be reproduced by two consecutive transmission 
(of real and imaginary part, respectively) over the real channel. 

Let 

A = dmgiai,...,ak)e&'"' (14) 

where aj E C, j = 1 . . . , k, are distinct points outside the unit 
circle, i.e., \aj\ > 1, and A' denote the conjugate transpose 
of the matrix A. Consider the linear dynamical system with 
open-loop matrix A shown in Fig. ID 

Si = 

S, = AS,_i+Y,_i, i = 2,3,... (15) 

where S,; ~ {Su, . . . , Ski)^ E represents the state of the 
system at time i, @ ~ (6i, . . . , Qk)^ is a vector of complex 
random variables such that 8i, . . . , 9fc are drawn i.i.d. from 
a uniform distribution over (0, 1) x (0, 1) C C, and e C*"' 
denotes the vector of complex channel outputs, i.e., 

Y, = BX, + Z„ Z, ^ CAA(0, K,) (16) 

where Xi E 'C here represents the scalar complex control 
signal, Zi E C'^ denote the noise vector at time i, and 

B = [!,..., (17) 



At every discrete time i, the control input can depend only on 
the state of the system at time i, so 

X, = 7r,(S,), 1 = 1,2,... (18) 

for some function tt,; : C'' — > C. We refer to the sequence {tt^} 
as the control. Since \aj\ > 1, the eigenvalues of A are outside 
the unit circle and the open-loop system (fTSl l is unstable. We 
say that the control {iTi} stabilizes the closed-loop system if 

limsup E(||S„|p) < oo 

n— )-oo 

where |lS„|p denotes the 2-norm of the vector S„. 

Given the system (fTsT i and the control ( fTSl l. we present the 
following sequence of n-codes for the fc-receiver AWGN-BC 
with feedback ( fTSl l. 

1) Encoder: At each time i E {I, . . . ,n} the encoder recur- 
sively forms Si as in (flST l and transmits Xi = 7ri(Si). 

2) Decoders: At each time i E {I, . . . ,n} decoder j forms 
an estimate Qji = —aJ^Sji^i^i) for the desired mes- 
sage 8j, where Sji is recursively formed as 

Sji = 

Sjt = ajSj^i^i) +Yjf^i^i), i = 2,3,...,n. (19) 

The following lemma characterizes the set of MSB exponent 
vectors that can be achieved by the sequence of n-codes so 
generated. 

Lemma 3: Let {tt;} be a stabilizing control for (flSl l. Then, 
the MSB exponent vector (log |ai|, . . . , log \ak\) is achievable 
under power constraint 

1 " 

P = limsup - E(7rf(S,)). 

i—l 

Proof: See Appendix iBl 

B. LQG Code based on Optimal LQG Control 

According to Lemma |3] for a fixed open-loop matrix A, 
any stabilizing control yields a sequence of n-codes for the 
AWGN-BC with feedback that achieves the same MSB ex- 
ponent vector (log |ai|, . . . , log \ak\) under a power constraint 
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determined by the asymptotic control variance. The following 
theorem characterizes the performance of the LQG code, 
which corresponds to the minimum variance control that can 
be computed using the LQG control theory. 

Theorem 1: Let A and B be given as in (fT4l l and ( fTTj l. 
and be the covariance matrix of the noise vector in the 
AWGN-BC (O. Then, the rate vector (log|ai|,. . . ,log|afe|) 
is achievable under power constraint 



where 



C = {B'GB + l)-^B'GA 



(20) 



(21) 



and G is the unique positive definite solutions to the discrete 
algebraic Riccati equation (DARE) 

G = A'GA - A'GB{B'GB + ly^B'GA (22) 

such that A—BG is stable, that is, every eigenvalue of A—BG 
lies inside the unit circle, and Kg is the unique solution to the 
discrete algebraic Lyapunov equation (DALE) 



K, = {A~ BG)K,{A - BG)' + K,_ 



(23) 



The proof of the theorem makes use of the following two 
lemmas. 

Lemma 4: Given the unstable open-loop matrix (fT4l i. the 
stationary and hnear control 



(24) 



where G and G are given in (l2Tl i and (l22l l. respectively, 
stabilizes the closed-loop system dTsl l and minimizes the 
asymptotic average control power 



limsupif]E(7r2(S,)). 



(25) 



i=i 



The minimum stationary power is given by 

tr(GK,) 

where Kz is the covariance matrix of the noise vector in (fT&i . 
Proof: Plugging ( fT6b into ( fTSl l. we have 



Si — ASi^i + BXi^i + Tii-i- 



(26) 



Consider the problem of finding the stabilizing control that 
minimizes the asymptotic average control power 



lim sup 



1 



This problem is similar to the standard LQG problem lUOl in 
the special case where the cost function does not depend on the 
state. For this problem, we can derive the Riccati equation (|22] | 
and the stationary linear control (l2ll . similar to the solution 
to the LQG problem, to establish a sufficient condition for 
optimality in terms of the asymptotic power 

Unlike the standard LQG problem, though, here we require 
the control to stabilize the system (see Lemma [3). Next, we 
show that there exists a unique solution to (|22] | such that the 
control G in ( 1211 1 is stabilizing, that is, A—BG is stable. Since 
the eigenvalues of A are all outside of the unit circle and the 



elements of B are nonzero we know (A, B) is detectable, that 
is, there exists a C € C^^*^' such that A — BG is stable. Then, 
by |fT2l Lemma 2.4] there exists a unique positive definite 
solution to (l22T i for which A — BG is stable. ■ 

The following lemma characterizes the asymptotic perfor- 
mance of the minimum variance control. 

Lemma 5: Let the linear control in (|24] | be stabilizing, that 
is, all eigenvalues of A — BG lies inside the unit circle. Then, 
the asymptotic average control power (l25t is given by 

GK,G' (27) 

where Kg is the unique solution to the following DALE 

Ks = {A- BG)Ks{A - BG)' + K,. 

Remark 1: From Lemma|4]and Lemma|5]it is clear that the 
performance of the described feedback code depends on the 
correlation among the noises at the receivers. 

Proof: Plugging (l24l l into the closed-loop system dynam- 
ics dm we have 



S, = (A-BC)S,_i + Z,_i. 

Let Kg i denote the covariance matrix of the state S^, then we 
have the following discrete algebraic Lyapunov recursion 

Ks^^+l = (A - BG)KsM - BG)' + K,. 

By assumption {A — BG) is stable and Kgxi >~ 0, hence 
the above recursion converges to the unique positive-definite 
solution to the following discrete algebraic Lyapunov equation 
(DALE) 

Ks = {A- BG)Ks{A - BG)' + K^. 

Note that X, ^ -CS^ and hence ^{X^) = GK^^G', which 
completes the proof. ■ 

Proof of TheoremU} According to Lemma |4] and Lemma |5] 
for A = diag(ai, . . . , a/c) with \aj\ > 1, there exists a 
stabihzing control with asymptotic power equal to (l20t . Fur- 
thermore, according to Lemma |3] we can construct a sequence 
of ncodes corresponding to this control, which achieves the 
MSE exponent vector (log |ai|, . . . , log |afc|) with the same 
asymptotic power as the control. Finally, by Lemma [T] we 
conclude that rate vector (log |ai|, . . . , log \ ak\) is achievable 
under asymptotic power constraint (l2&t . ■ 

Example 1: Consider the special case of a two-receiver 
AWGN-BC, and let 



A^ 



ai 
a2 



1 P 
P 1 



for |ai| > 1, \a2\ > 1, and -1 < p < 1. By solv- 
ing ( |22] | and plugging the solution into ( l20l i we obtain that 
(log I ai I, log 1 02 1) is an achievable rate pair under power 
constraint 

^(Ka2-lp(|aip + |a2p-2) 

\ai - V 

-p(|ai|2-l)(|a2p-l)(Re(ai4)-2)). 

In the special case where the noises at the receivers are 
independent (p = 0), the code in lH has the same performance 
as the LQG code. 
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V. Independent Noises: Power Gain 

In this section, we analyze the performance of the LQG 
code in the special case of independent noises, i.e., assuming 
that Kz = Ikxk, which is the case for most practical scenarios. 
We characterize the sum rate R{k, P) achievable by the LQG 
code under power constraint P for the symmetric case where 
diagonal elements of A in (fl4] i are 



-(j-i) 



(28) 



and a > 1 is real. 

Theorem 2: Given A as in (l28T l, the LQG code achieves 
symmetric sum rate R{k,P), i.e., Rj — R{k,P)/k, j — 
1, . . . ,k, under power constraint P where 

i?(fc,P) = ilog(l + P0) 

and (l){k, P) is the unique solution in the interval [1, k] to 

fe 



(1 + P0) 



fc-i 



1 



cj^ik - 0) 



Remark 2: The quantity 0(fc, P) is the power gain com- 
pared to the no feedback sum capacity l/21og(l + P). This 
power gain can be interpreted as the amount of cooperation 
among the receivers established through feedback, which 
allows the transmitter to align signals intended for different 
receivers coherently and use power more efficiently. 

Proof: For A defined as ( |28]) . we know by Theorem [T] 
that the sum rate R = A; log a is achievable under power 
constraint P = tr(G) where G is the unique solution to the 
DARE ( |22] |. The following lemma characterizes the solution 
to the DARE ( |22] | for the symmetric choice A. 

Lemma 6: |13, Lemma 12] Suppose that the open-loop 
matrix A is of the form ( l28T l. Then the unique positive- 
definite solution G to (l22l) is circulant with real eigenvalues 
Ai > A2 > . . . > A/c > satisfying 

Ai = ^Aj_i 
a 

for i = 2, . . . , k. The largest eigenvalue Ai satisfies 

1 + fcAi = a^'' (29) 
+ X,{k-^))=a^(''-'\ (30) 

From (|29] | and 



we have 



(l + fcAi)'-^= (l + Ai(fc-^) 



(31) 



The solution to ( l22b is unique and we conclude that ( [3T] l has 
a unique solution for Gjj given Ai and vice-versa. Consider 
Ai(fc, P) corresponding to the case where 

P 



3 



1, 



Note that the solution G to (|22] | is circulant and has equal 
elements on the diagonal. From (|29] l we know the LQG code 
corresponding to Ai(fc,P) achieves sum rate 

fcloga- ilog(l + fcAi(fc,P)). 



under power constraint tr(G) = P. The following change of 
variable 

completes the proof. ■ 



A. Comparison with the AWGN Multiple Access Channel 

The LQG approach can be also apphed to the AWGN-MAC 
with feedback. It is known [6l that the LQG code for AWGN- 
MAC has the same performance as the Kramer code [71, 
which achieves the linear sum capacity |[T3l . the supremum 
sum rate achievable by linear codes. Let RyiAcik, P) denotes 
the symmetric sum rate achievable by the LQG code for the k- 
sender AWGN multiple access channel (MAC) with feedback 
where each sender has power constraint P. Then, we have ||6l 
Theorem 4]: 

RMAc{k,P)^llog{l + kP^) 

where <j>{k,P) is the unique solution to 

(1 + fcP0)^-i = (1 + P0(fc - (j)))'' . 
Comparing with Theorem |2] it is not hard to see that 

RBc{k,P)^RMAcik,P/k). 

This shows that under the same sum power constraint P, the 
sum rate achievable by the LQG code over MAC and BC are 
equal. This connection between the MAC and the BC is also 
considered in 1,5J. 

B. Ozarow-Leung (OL) code for k = 2 

We compare the LQG code with the OL code for k — 2 and 
Kz = I. The OL code can be represented as follows ifTTl : 



Xi — Sii + S2 



where 



'Si' 




'a ■ 










i+1 


-a 


( 


.^2. 


i 



E[SiiYi, 







Q E[52.l2.] 



(32) 



In the sequel, we present the LQG code in a similar form 
as ( [32] l for comparison. Let the system in ( fT5t be re-written 

as 

S, =AS,_i+diag(S)Y,_i. 



where 



A = 



a 

-a 



B = 



-b 
b 



(33) 



where 6 ^ is any constant and a > 1. The choice of b 
does not affect the performance of the optimal control as one 
can cancel out the effect of b by properly scaling the control 
signal. Thus, without loss of generality, in ( fTsT i we picked 
6=1. According to the channel (fTSI l the closed-loop system 
is 

S, = AS,_i + PX,_i + diag(P)Z,_i. 
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By substituting B with B, the optimal control can be charac 
terized by Lemma|4]as follows. The solution to the DARE 
is 



G 



which yields the optimal control 



a' 1 
a2 1 



C = [Ci C2] 



1) 



[1 1] 



To obtain the power we need to substitute = I with 

Q = diag(B) diag(B)' 



V 

&2 



and the asymptotic variance of the channel input X is given 
by 



P = tr(GQ) = tr(G) 



1 

2^ 



(a2-l)(a2 + i)2 



(34) 



Notice that ( |34] l does not depend on the parameter b. Thus, 
we can choose b arbitrarily without affecting the overall 
performance of the code. In particular, by choosing 



2a3 



we have that Xi = Su + 821 as in the OL code. However, the 
state in OL is updated as in (|32] | while in the LQG code. 



(35) 



To compare with the OL code, we need to find the asymptotic 
covariance matrix of the state. By substituting with Q, the 
asymptotic covariance matrix A'^ is given by the DALE ( |23] ), 







a ■ 








'b/a 


■ 








.•52. 


i+1 


-a 


( 




i 





b/a 









2a2 



^2 



and 



lim 



lim , „ 



tr(GQ) + 1 
a3(a2 - 1) 



Notice that 



b- 



a^a^ - 1) 
+ a4 + a2 - 



6 



Therefore, unlike in the point-to-point setting discussed in 
Section [nil here the OL code and the LQG code are not 
asymptotically equivalent. Although both codes achieve rate 
pair (log a, log a), by Lemma |4] the OL code requires more 
asymptotic power than the LQG code and hence it is subop- 
timal. 



VI. Correlated Noises: Pre-Log Gain 

In this section, we show that structured correlation among 
the noises at the receivers can increase the capacity signif- 
icantly. We consider the high power regime and study the 
pre-log j{Kz) as a function of covariance matrix K^, which 
represents the number of orthogonal point-to-point channels 
with the same sum capacity. 

Theorem 3: For all of rank r 

^{K,.) <k~r + l. 

Conversely, for any r = 1, . . . ,k, there exists such that 
rank(iir^) = r and 

7(X,) = fc-r + l. 

Proof: First, we prove the upper bound by induction. By 
assumption contains r linearly independent rows, let us 
assume, without loss of generality, the last r rows. Assume 
that receivers /c — r + 1 , • • • ,k share their received signals and 
form a single receiver equipped with r receive antennas and let 
Yk-r+i ■= {Yk-r+1, ■ ■ ■ , Yk)"^ denote the vector of received 
signals by this multiple antenna receiver The corresponding 
AWGN vector BC with feedback is specified by 



Yfc_r+1 = 'i-rxlX + Zik-r+1 



L 



whem {Zi,---,Zk-r,'Zk-r+i) ^ N{0,K^), Zk-r+i ^ 
N(0, Kz), and by assumption Kz is full rank and invertible. 

Now suppose that the sender of this channel wishes to send 
message Alj to receiver — l,---,k — r + 1, under power 
constraint P. Since we made the optimistic assumption that 
a subset of receiver can cooperate, the sum capacity of this 
channel is an outer bound on the sum capacity of the original 
AWGN-BC. Note that for every j = 1, • • • , fc — r, the rate 

< ilog(l + P) 

is upper bounded by the capacity of the point-to-point AWGN 
channel. The rate Rk-r+i for the (fc — r+ l)-th receiver with r 
multiple antenna is upper bounded by the capacity of a single 
input multiple output (SIMO) 1 14] channel: 

1 
2 



Rk-r+l < ^log(l+P|i^-51^^,|2) 



where by assumption K is invertible. Thus, the sum capacity 
of this channel is upper bounded by (fc — r)/2 log(l + P) + 
l/21og(l + P|A:-H^xiP), and therefore the pre-log j{Kz) 
can be at most fc — r + 1. 

Next, we show jiK^) — k is achievable by the LQG code 
for some of rank one, i.e., r = 1. For r = 2,...,fc 
similar argument holds. Suppose that the open-loop matrix A 
is as in ( |28] ). By Theorem [T] the symmetric rate vector 
(loga, . . . ,loga) is achievable under the power constraint 
tr(GA'^), where G is the circulant matrix in Lemma |6] Note 
that any circulant matrix can be written as FAF', where F is 
the k point discrete Fourier transform matrix with 

1 



F,i 



Vk 
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for j,k £ {1, ■ ■ ■ and A — diag([Ai, . . . , Afe]) is the 
matrix with eigenvalues on its diagonal. Suppose that the noise 
covariance matrix is also a circulant matrix with diagonal 
entries equal to 1. In particular, let 

k.^FKF', A = diag([0,...0,fc]). (36) 

Then, we have 

tr(Gi^^) = tr(FAAi^') = k\k 
where by Lemma |6] 



fcAfc = 



fcAi 



,2fe 



1 



Q2(fe-i) a2(fc-i) ■ 

Therefore, for the symmetric choice of A in 
code achieves sum rate 



R—k log a 



the LQG 



(37) 



under power constraint 



P = tT{GK,) = 



and we have 



lim 



(38) 



P^oo 1 log(l + P) 



> lim 



R 



P^oo 1 log(l + P) 



— lim 



k. 



fcloga 
iloga2 



(39) 



where (|39] l follows by plugging sum rate R and power P 
from (l37T i and dJSl l. Moreover, we know 7(A'^) < fc since 
ia,nk{Kz) = 1. Hence, 'j{Kz) = k for the covariance matrix 
k, in dill). 

To complete the proof, we show that for every r £ 
{2, . . . , k — 1} a pre-log equal to fc — r + 1 is achievable 
for some such that rank = r. Consider 



Mk-r+l.k-r+l Ofe_.r+l,r-l 
Or-l,fe-r+l Ir-l.r-1 



where Oij denotes the zero matrix of dimension i x j, la 
is the identity matrix of dimension i, and Mk-r+i,k-r+i is 
the {k — r + 1) x {k — r + 1) circulant matrix having first 
row equal to the last column of the discrete Fourier transform 
matrix of dimension (fc — r + 1) x (fc — r + 1). Clearly, 
rank(_R'2) — rank(A/fc_r+i.i;--r+i) +rank(/j._i..r-i) = r. On 
the other hand, suppose that the transmitter communicates only 
to users 1, 2, • • • , fc — r + 1, while the transmission rate for the 
remaining users is set to zero. We can use a similar argument 
as above and show that the LQG code for the corresponding 
(fc — r + l)-receiver AWGN-BC with feedback and noise 
covariance matrix M^^r+Lk-r+i achieves a pre-log equal to 
fc - r + 1. ■ 
Remark 3: To achieve -f — k, we used the LQG code. 
However, the same pre-log can be achieved even with codes 
which are less power efficient since we are considering only 
the pre-log of the sum rate in the high power regime. For 



instance, for the special case of fc = 2, Gastpar and Wigger ||3] 
showed that the OL code, which is suboptimal, achieves pre- 
log two for anti-correlated noises. 

VIL Conclusion 

Using tools from control theory we have presented a code 
for the fc-user AWGN-BC with feedback, called the LQG code, 
which we have then used to investigate some properties of 
the capacity region of this channel. When the noises at the 
receivers are independent the pre-log of the sum capacity is 
at most one, so feedback can yield at most a power gain over 
the case without feedback. We have quantified the power gain 
achieved by the LQG code and shown that in the case where 
k — 2, the LQG code recovers a previous result of Elia which 
strictly improves upon the OL code. In the case where the 
noises at the receivers are correlated, instead, the pre-log of the 
sum capacity can be strictly greater than one. We established 
that for all noise covariance matrixes of rank r the pre-log is 
at most fc — r + 1 and, conversely, there exists a covariance 
matrix for which this upper bound is achieved by the LQG 
code. In particular, a pre-log equal to fc is achievable for some 
circulant noise covariance matrix of rank one. This generalizes 
previous results obtained by Gastpar and Wigger for the case 
fc = 2. 

The LQG approach exploited here could be in principle 
useful for other multi-user communication channels with feed- 
back, when the subclass of Unear codes can lead to optimal 
or close to optimal solutions. 

Appendix A 
Proof of Lemma[T] 

The proof is closely related to the proof of an analogous 
statement for the communication problem over the multiple 
access channel with feedback |6| . By assumption, there exists 
a sequence of n-codes for 8j ^ Unif(0, 1), such that 



lim 

n— >oo 



1 



in) 



3 



1, 



,fc 



(40) 



and (|2|i holds. Given the sequence of n-codes and Rj < Ej, 
j — 1 . . . , k, we construct a sequence of (2"^^ , • ■ • , 2"^*= , n) 



codes such that lim„^oo Pn 



(n) 



0. 



First, we map the discrete message nij e A4j = [1 : 2"^^] 
to a message point 9j{mj) E &j, where &j is a set of 
2"^j message points in the unit interval such that the distance 
between any two message points is greater than or equal to 
2-nRj ^ Xo send raj S Mj, we use the given n-code and 
the corresponding message point 9j{mj). The decoder first 
forms the estimate of the message point Oj{y" ) according to 
the given n-code, and then chooses rhj such that 9j{rfij) is 
the closest message point to 6j{y"). As the distance between 
any two message points is greater than or equal to 2^"^\ the 
average probability of error is bounded as follows. 



Pj"' < max max P 



19, -6,1 



-7lRi 



(41) 
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To show lim„ 



^ / , ^ — U, consider 




,:=p |e,-e,|>-.2-"«^ 
I ^ J 


(42) 




(43) 




(44) 


^ _ 2 — '27i(Ej—Rj~en) 


(45) 



where e„ — > as n oo. The inequalities (l43l l and (l44l l 
follow from the Chebyshev inequality and (|40| |. respectively. 
From i45[ and the assumption Rj < Ej, we have 



Pj,n — > as n — > j = 1, . . . , fc. 



(46) 



Next, by the similar argument as in [15, Lemma II. 3] we 
show that condition (|46] | is sufficient to prove that there exists a 
set of message points in the unit interval such that the distance 
between any two message points is greater than or equal to 

2-"-^. and 



lim max P 



0.1 > ^-2 



-nB.i 



for j ^l,...,k. 
Define the event 

T,.„ = {0e(O,l) : 

p{|0.-©.l>^-2-"^1e, = 0} 

Then we have pj „ > y^Pj^P{Tj^n) and hence 

To choose 0j such that 0^ n T^.n = and also the distance 
between any two message points is greater than or equal 
to 2-"^^ it is sufficient that |0j|2-"-"^' < 1 - ^/p— or 
considering (l46T l. 

|0,|<(l-e„)-2"«'^- 

where e„ — > as n — cxi. Moreover, by the definition of T, „ 
and the fact that 0j n r„ = we have 



max P 



1 



le - ei > - • 2-"-"^ 

' ' 2 



(48) 



and considering ( |46] l, the condition ( |47] i holds. 

Combining (l4Tl i and ( l47l i. we have lim„^oo -Pi"'' = 0. 
Moreover, since the given 7i-code satisfies the power con- 
straint P, the constructed (2"^^ , ■ • • , 2"-'^'= , n) code also sat- 
isfies the same power constraint. Hence, we conclude that 
the rate vector . . . , R^) is achievable under power con- 
straint P. 



where A = diag(ai, . . . , a^) is the same as in (fT4b . Consider- 
ing the recursion for S^, we can rewrite the system dynamics 
given in (fTSl l as 



S,+i = + S,+i 
= AX0-0^) 



(49) 



where 0^ — {Qu, . . . , Qki)^ and the last equality follows 
from the decoder rule by which Qji = —a^ Sji^ij^iy From ( |49] l, 
the MSE for the message 8j at time n is given by 

where Kn '■— Cov(S„) is the covariance matrix 
of S„. The achievability of MSE exponent Ej = 
log(|aj |) follows from (ISOl l and the assumption of stability 
linisup„^QQ(7^„)jj < oo. The asymptotic power follows 
from the fact that Xi ~ 7rj(Si). 
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Appendix B 
Proof of Lemma[3] 

Let Si = {Sii, . . . , Skiy where Sji is given in ( fT9] l. Then, 
we have 

Si =0 

S, = AS,_i +Y,_i i = 2,3,... 



